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(54) Digital camera 

(57) Digital camera techniques improve the conven- 
ience of a live view display and the like. Image process- 
ing in a digital camera includes image processing (i.e.., 
live view processing) for real-time display of a subject 
on a liquid crystal monitor and image processing per- 
formed on image signals followed by image capture for 
recording. Both the image processing is performed by 



a single common image processor. In image capture for 
recording, high-priority live view processing (Pc) is per- 
formed between writing (Pa) of image signals outputted 
from a CCD into memory and captured image process- 
ing (Pb). This shortens the time of not displaying a live 
view image, thereby preventing a shutter release oppor- 
tunity from being missed and improving the conven- 
ience of a live view display. 
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Description 

[0001] This application is based on application No. 
2000-44471 filed in Japan, the contents of which are 
hereby incorporated by reference. 5 

BACKGROUND OF THE INVENTION 

Field of the Invention . 

w 

[0002] The present invention relates to digital camera 
techniques and especially to improvements in the con- 
venience of a live view display and the like. 

Description of the Background Art 15 

[0003] On release of the shutter, conventional digital 
cameras stop a live view display, i.e., a real-time display 
of a subject on a monitor, and perform image processing 
for image recording which is followed by the shutter re- 20 
lease, then perform image processing for live view dis- 
play after the completion of the image processing for re- 
cording. . .''..< 

[0004] Because all the image processing is conduct- 
ed by a single image processor, a us'er'cannot visuafiy 25 
identify a live view image for a while after a shutter. reT 
lease until the image processing. for recording is com- 
pleted. . . ■■ ; • 
[0005] Fig. 15 shows an example of a sequence of 
operations of the conventional digital cameras. ; v .-. ; so 
[0006] After a shutter release operation, i.e.; a full 
press of the shutter release button, a time Ta for expo- - 
sure and storage in a CCD, a time Tb to read out image 
data stored in the CCD, correct the black level and the 
like of the image data, and write resultant raw data into 35 
memory, and a time Tc for the aforementioned image 
processing become necessary. During those times or a 
total time Td (= Ta + Tb + Tc), a live view display is not 
produced. <■ . ' 
[0007] An image pickup device with approximately 40 
one-million-pixel resolution requires a relatively short 
time of image processing. Thus; not displaying a live 
view image during the image processing is felt quite nor- 
mal by a user without a hitch. 

[0008] However, a digital camera having an image 45 
pickup device with approximately five- to six-million pixel 
resolution has large amounts of data to be processed. 
In this case, it can be predicted that the time during 
which a user cannot visually recognize a live view dis- 
play will increase. Such an increase in the time of not 50 
displaying a live view image may cause problems such 
as missing a shutter release opportunity, impairing the 
convenience of the digital camera because of unpleas- 
antness in framing during image capture, and the like. 

55 

SUMMARY OF THE INVENTION 

[0009] • The -present invention is directed to a digital 
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camera. 

[0010] The digital camera of the present invention 
comprises: image capturing means capable of selec- 
tively generating a first image signal and a second im- 
age signal; storage means for storing the second image 
signal; image processing means for performing first im- 
age.processing on the first image signal and performing 
second image processing, which is lower in priority than 
the first image processing, on the second image signal; 
and timing control means for storing the second image 
signal generated by the image capturing means into the 
storage means at a first timed instant, for supplying the 
first image signal generated by the image capturing 
means to the image processing means at a second 
timed instant after the first timed instant, and for reading 
out and supplying the second image signal stored in the 
storage means to the image processing means at a third 
timed instant after the second timed instant. Therefore, 
the image processing on the first image signal can be 
performed preferentially, which improves the conven- 
ience of a live view display and the like. - 
[0011] in a preferred embodiment of the present in- 
vention, the second image signal in the digital camera 
is an imagei signal for recording. Thus, the image 
processing for recording, which does not have to be per- 
formed quickly, can be postponed. 
[0012] An object of the present invention is therefore 
to provide digital camera techniques that improve the 
convenience of a live view display and the like. 
[0013]". These and other objects, features, aspects 
and advantages of the present invention will become 
more apparent from the following detailed description of 
the present invention when taken in conjunction with the 
accompanying drawings. 

BRIEF DESCRIPTION OF THE DRAWINGS 

[0014] 

Figs. 1 to 3 show a main construction of a digital 
■ - camera 1 according to a first preferred embodiment 
of the present invention; 

Fig. 4 is afunctional block diagram of the digital 
camera 1; 

Fig., 5 shows mapping in main storage space in a 
main CPU 2T; - ~ . • 

Figs. 6A and 8B are flow diagrams of *• image 
processing in the main CPU 21; 
- Fig. 7 is a flow chart of the operation of the digital 
camera 1 ; . < 

Fig. 8 shows an example of a sequence of opera- 
tions of the digital camera 1 ; ' ' * 
Fig. 9 is a flow chart of the operation of a digital cam- 
era 1 A; ■ . 

Fig. 1 0 shows an example of a sequence of opera- 
tions of the digital camera 1 A; ■ -j 
Fig. 11 is a flow chart, of the operation of a digital 
camera^'B; . . .. •. *. • 



EP 1 133 167 A1 



2 



BNSDOCID: <EP 1 133167A1_I_> 



4 



3 

Fig. 1 2 shows an example of a sequence of opera- 
tions of the digital camera 1 B; 
Fig. 13 is a flow chart of the operation of a digital 
camera 1C; 

Fig. 14 shows an example of a sequence of opera- 
tions of the digital camera 1C; and 
Fig. 15 shows an example of a sequence of opera- 
tions of a conventional digital camera. 

DESCRIPTION OF THE PREFERRED ; 
EMBODIMENTS 

< First Preferred Embodiment , ■ i ■-■ ■ • 

<Main Construction of Digital Camera> : . 

[0015]. Figs, i through 3 show a main construction of 
a digital camera 1 according to a first preferred embod- 
iment of the present invention. Fig. 1 is a plan view, Fig. 
2 is a cross-sectional view.taken along the line 1 1 -I I of 
Fig. 1, and Fig. 3 is a rear view. These figures are: not 
necessarily drawn based on the third angle projection, 
but are intended to conceptually illustrate the main con- 
struction of the digital camera 1. This digital-camera 1 
is common to each . of the following preferred ^embodir 
ments. . , w : ' oc- •** 

[0016] - As shown in: Figs. 1 to;3, the digitatcarriera< 1 
has the shape of a general . rectangular parallelepiped; 
[0017] An image capturing circuit .302 having a: GGD 
color area sensor 303 is'provided in positiori behind a 
lens group 30 with macro- capability serving as.- taking 
lenses. The lens group 30 includes a zoom lens 300 and 
a focusing lens 301 .. ■■• v .- '- .- 
[001 8] A camera body 2 comprises a zoom motor M 1 
for changing the zoom ratio of the zoom lens 300 and a 
motor M2 for driving the focusing lens 3Q1 : to achieve 
focus. 

[001 9] The front surface of the camera body 2 is pro- 
vided with a grip G. A pop-up built-in flash 5 is provided 
in position in an upper end part of -the camera body 2. 
A shutter release button 9 is provided on the upper sur- 
face of the camera body 2, .The shutter release button 

9 has the function: of detecting and judging between its 
half-pressed position at which it serves as a trigger for 
focus adjustment and^its full-pressed position at which 
it serves as a trigger for image capture for recording. 
[0020] . Referring to Fig. 3, the rear surface of the cam- 
era body 2 has a liquid .crystal display (LCD) 10. and an 
electronic viewfinder (EVF) 20 both for a live view dis- 
play of a captured image, a playback of a: recorded im- 
age,, and the. like; Unlike anjoptical viewfinder, the'LCD 

10 and the EVF 20, both;-.usingjmagc. signals from the 
CCD, 303 for display, pfay a role^as .a viewfinder,.. ' 
[0021] The rear surface of the camera body 2 also has 
a recording/playback mode selection switch 14 for se- 
lection between a recording: mode and a playback 
mode. The recording mode is the mode of picture taking, 
and the playback mode is the mode of playing back and 
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displaying on the LCD 10 captured images recorded on 
a memory card 8. 

[0022] A crossed switch 35 with buttons U, D, L and 
R is provided in a right-hand position on the rearsurface 
5 of the digital camera 1 . Pressing the buttons L and R 
drives the zoom motor M1 for zooming. The buttons U, 
D, L and R are used for various operations. 
[0023] An LCD button 31 , an OK button 32, a cancel 
button 33 and a menu button 34 are provided on the rear 
surface of the camera body 2. 

[0024] The camera body 2 has an external monitor 
terminal 222 on the side surface. The external monitor 
terminal 222 is a terminal for transmitting image data 
and the like from the digital camera 1 to an external mon- 
itor. . ■ . - 
[0025] As illustrated in Fig. 1 , the digital camera 1 is 
capable of loading the memory card 8. The digital cam 1 
era 1 is driven by a power battery E having four in-series 
connected AA.ce lis E1 Xo E4. 

<Functional. Blocks of Digital Camera %>■' 

[0026] Fig. 4 is a functional block diagram of the digital 
camera 1 . - - * - -" . ; 

[0027] :The CCD 303 changes an -optical subject im- 
age, which- is formed by the lens group 30, by photoe- 
lectric conversion into.an image signal having R (red), 
G (green) and B (blue) color components (i.e., into a sig- 
nalcomprised of asequence of.pixel signals received 
at respective pixels) %f or output. .The interline CCD 303 
has -2,000 horizontal pixels and<1;,500 vertical pixels, i. 
e:, provides a three-million-pixel. resolution. For readout 
of all pixels, 750 lines each are read out at two different 
times j . - ■ 

[0028} ; A signal processor-313, by using a CDS (cor- 
related double sampling) circuit 1 and' an A/D converter 
fort converting. an output of the.CCD 303 into digital im- 
age data format, transfers digital image data to a. CPU 
for digital camera (hereinafter referred to as "a main 
GPU") 21. - - 

[0029] A timing generator (TG) 314 generates various 
timing pulses for controlling the drive of the CCD 303. It 
also has the function of changing the types of image sig- 
nals outputted from the CCD 303. 
[0030] - The main CPU 21 is in the form of a single chip 
on which necessary functions for the digital camera are 
implemented. ;The main CPU 21 comprises an image 
signal, processor^ 11 , a JPEG section 212, and a video 
encoder 2.1 3. Jt further comprises a memory card con- 
troller 214, a clock generator 215, SIOs (clock serial in- 
terfaces) 21 6, a RISC-CPU core 21 7 for controlling each 
section, and a buscontroller 21 8. 
[0031] , The image signal processor 211 performs 
processing such as color space conversion into YCrCb 
data (which will later be described in detail). 
[0032] The JPEG section 212 has the fmcrions. of 
compressing image data processed by the image signal 
processor 211 »and expanding image-data. fetches' from 
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the memory card 8 both in the JPEG format. 
[0033] The video encoder 21 3 processes image data 
generated by the image signal processor 211 and con- 
verts resultant image data into digital composite signals 
that conform to a television-style format such as NTSC 
or PAL, then into analog composite signals by a D/A con- 
verter. • * 

[0034] The memory card controller 214 inputs* and 
outputs image data from and to the memory card 8. 
[0035] The clock generator 215 sends out clocks to 
the TG 314. 

[0036] The SIOs 216 make data transfer for control- 
ling the signal processor 313, theTG 314, and a camera 
CPU 22. 

[0037] The bus controller 218 controls input/output 
data from/to external memory 23 over a bus 219. It also 
severs as a DMA (direct memory access) controller. 
[0036] The external memory 23 is comprised of a 
flash ROM 231 for storing. program data and a volatile 
DRAM 232 for accumulating image data or the like. The 
flash ROM 231 is. capable of storing program data re- 
corded on the memory card or recording medium 8 
through the memory card, controller 214. The program 
data stored can be reflected in the operation of the digital 
camera 1 . A control program to be described later can 
also be installed in the digital camera 1 from the memory 
card 8. 

[0039] The camera CPU 22 controls the operation -of 
the digital camera 1 . That is, the cameraCPU;22 per- 
forms a camera sequence; being con nected to a user- 
operated operating member 225 such as the shutter re- 
lease button 9, a componentdetecting member 226 for 
detecting the positions of mechanisms such as the lens 
group 30, and an actuator driver 227 for driving actua- 
tors such as. the zoom motor M1 . 
[0040] Fig. 5 shows mapping in main^ storage space 
in the main CPU 21. , . ; ■ 

[0041] An area 21a for flash ROM is. for storage of. a 
control program of the main CPU 21 .. At power-on/ the 
program code is executed from beginning:. < ' ' 
[0042] An area 21b for DRAM is for storage of pro- 
gram work data or image data being processed before 
written into the memory card 8. The area 21 b has stor- 
age capacity of a plurality of images. 
[0043] An area 21c for data input from the CCD 303 
is for writing of data outputted from the signal processor 
313. 

[0044] Areas 21 d and 21 e for image signal processor 
input/output are for image processing such as color 
space conversion into YCrCb. . 
[0045] Areas 21 f and 21 g for JPEG input/output are 
for JPEG image compression/expansion.- 
[0046] An area 21 h for video encoder output is for writ- 
ing of digital composite data generated by image signal 
processing. • 
[0047] An area 21 foi memory card input is for readout 
of data frbm^the memory card 8,* and an area 21 j for 
memory card output is for writing of data to the. memory 



card 8. 

[0048] . An area 21 kfor other setting registers is for set- 
ting of internal storage resources in the main CPU 21 . 
[0049] Now, data transfer in the main CPU 21 will be 

5 described. 

[0050] In the main CPU 21 , the use of the function of 
the bus controller 21 8 as a DMA controller allows direct 
data transfer between each module for which a DMA 
channel is set up and the DRAM 232. The settings of 

10 the DMA channels are as follows: 

. (1) -DMA channel 1: image signal processor to 
. DRAM; • 

(2) DMA channel 2: DRAM to image signal proces- 
15 scr; 

(3) DMA channel 3: image signal processor to 
DRAM; 

(4) DMA channel A: DRAM to JPEG section; 
. (5) DMA channel 5: JPEG section to DRAM; 

20 (6) DMA channel 6: DRAM to video encoder; 

(7) DMA channel 7: DRAM to memory card control- 
ler; and 

.■(8) DMA channel 8: memory card controller to 
. DRAM. 

25 . 

[0051] For data transfer control by DMA, an enabling 
bit of/a DMA setting register in the main CPU 21 is first 
enabled' and data to be transferred by each module is 
generated. On a DMA transfer request to the bus con- 

30 tro!ler218, the bus controller 218 judges priorities in 
DMA and starts DMA: Once DMA is started, data can 
be transferred between each module and the DRAM 
232 without software intervention. The bus controller 
218 also conducts arbitration of the bus 219 for each 

35 predetermined number of bytes, thereby to arbitrate be- 
tween each of other DMA requests. 
[0052] In this 'arbitration, if the data input from the 
CCD'303 and the output to the video encoder 213 are 
assigned the highest priority in DMA, data transfers over 

40 these two channels take priority over the other DMA re- 
quests. The other DMA channels are given the same 
priority, and when the arbitration is required, modules 
which-have been executed are in turn assigned the low- 
est priority in a round-robin fashion so that these mod- 
ules are executed in sequence. 

[0053] The flow of image processing in such a digital 
camera 1 will now be described. 



50 



<Flowof Image Processing in Main CPU 21 > 



[0054] . Figs.- 6A and 6B are flow diagrams of image 
processing in the main CPU 21 utilizing the above DMA. 
Fig. 6A shows the flow of image processing for live view 
display, and Ftg.= 6B shows the flow of image processing 
55 for acquisition of an image for recording followed by a 
l'uH'press of the shutter release button 9. 
[0055] In the image processing for live view display, 
for display of 30 frames per second on the LCD 10 and 
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the EVF 20, a draft mode of reading out one line for eve- 
ry five vertical lines of pixels by means of subsampling 
is adopted in a method of reading out captured image 
data from the CCD 303. This permits fivefold scanning 
speed, i.e. , 30-frame-per-second readout, as compared 
with an all pixel readout method that permits only 
6-frame-per-second readout. 

[0056] The main CPU 21 exercises control over the 
TG 314 through one of the SIOs,21 6 so that the setting 
of the TG 314 is adjusted to clock generation, for 
30-frame-per-second live view display. At this time, the 
main CPU 21 enables the DMA channel 3 for output 
from the image signal processor 21 1 and the DMA chan- 
nel 6 for video encoder output. Then, image data as a 
first image signal, which is outputted from the CCD 303 
at 30 frames per second, enters in sequence at the im- 
age signal processor 211 , where the image data goes 
through a processing part21 1 a for black level correction 
and white balance control and a processing part 211b 
for gamma correction and interpolation to generate RGB 
data from CCD Bayerdata, and is converted into YCrCb 
in a color space conversion part 211 c. Then, edge en- 
hancement of the Y signal is performed in an edge en- 
hancement part 21 1d, the result of which is written into 
the DRAM 232 overthe DMA channel 3. The image data 
written into the DRAM 232 is transferred over the DMA 
channel 6 to the video encoder 213, which then gener- 
ates and outputs composite video signals for image dis- 
play on the LCD 10, the EVF 2Q, and the like. The timing 
of readout-from the DRAM 232 by the video encoder.2-1 3 
overthe DM A channel 6 is in synchronization with a syn- 
chronization signal for driving the- LCD 1 0. At this time, 
such a horizontal resolution of pixels as in the image 
data is unnecessary for display on the LCD 10 and the 
like; therefore, approximately 640 horizontal pixels are 
read out by subsampling. As described so far, live view 
processing and display are performed in this fashion.' 
[0057] Next, the flow of image processing for acquisi- 
tion of an image for recording is discussed. On a request 
for acquisition of an image for recording from the camera 
CPU 22, the main-CPU 21- adjusts the setting of each 
module for acquisition of, an image for recording. That 
is, the DMA channels 1 to 7,are enabled and the main 
CPU 21 exercises control over the TG 314 through one 
of the SIOs 216 so that the setting of theTG 314 is ad- 
justed to clock generation for. acquisition of an image for 
recording and an electronic shutter speed of the CCD 
303 is set as requested by the camera CPU 22. Then, 
image data as a second image .signal accumulated in 
the CCD 303 is subjected to image processing by the 
black level correction/white balance, control part 2*1 1 a in 
the image signal processor 211 and is written as raw 
data (raw image data) to the DRAM 232 overthe DMA 
channel 1 in two parts, at.two. different times. Aftenthe 
writing to the DRAM 232 is complete, the completion of 
readout by the CCD 303 is : detected and the data written 
into the QRAM 232 is again read out by thejmage signal 
processor 211 over the DMA channel:2. In the.; image 



signal processor211 , the processing part 21 1 b for inter- 
polation and gamma correction, the color space conver- 
sion part 211c ; and the edge enhancement part 21 1d 
* perform image processing as is the case for live view 

5 display; and resultant YCrCb image data is written again 
into the DRAM 232 over the DMA channel 3. After all 
image data is written into the DRAM 232, the JPEG sec- 
tion 212:reads out the data- over the DMA channel 4 and 
performs JPEG compression. The JPEG section 212 

10 then writes the result of JPEG compression into 'the 
DRAM 232 over the DMA channel 5. The DRAM 232 
has arranged therein JPEG data obtained through im- 
age compression and transfers the same tdthe memory 
card controller 214 overthe DMA channel 7 to create a 

is fjie in the memory. card 8. As described so far, the image 
processing for acquisition of an image for recording -is 
performed in this fashion, v -* ' r :C 
[0058] The image processing (filtering process) by-the 
image signal, processor 211 ■ is : common -to' both the 

20 aforementioned live, view processing -and. the-'process- 
ing.for acquisition. of- an. image for recording, but the im- 
age processing {image compression if or recording) by 
the.JPEG section 242 is 1 peculiar ta the- processing for 
acquisition of anumagcrfor recording.' : 

<Operatio.n of Digital Camera !> 

[0059] n Fig:; 7;is a flow chart of the operation of the dig- 
ital camera )1: Fig-, 8 shows an example of a sequence 
;\30 of operations.©! the. digital -camera 1. 

[0060] \rWhen: the digital camera . 1 is switched on, 
whether the shutter release button 9 is fully pressed or 
not, i.e., an operation to acquire an image for recording 
is performed or not, is determined' (step ST 1 ). With a full 

35 press of the shutter release button 9, the process goes 
to step ST8 ; ; Otherwise,: the. process goes to : step ST2. 
[0061] In step ST2, live view processing is performed. 
In step ST3, image data^ obtained through the live view 
processing is displayed on the LCD 10 and the EVF 20. 

40 [0062] In step ST4, whether or notthe mode selection 
switch 14 is used for >av power- off operation is -deter- 
mined. When the poweroffloperation is performed, . the 
process gaes-to step^STS. Otherwise, the process re- 
turns to step ST1 , 

45 [0063] In step ST5, image processing is performed by 
the image signal processor 211 on a frame of image cap- 
tured just before the power-off operation. 
[0064] In step STB, image compression is performed 
by the JPEG section 212 and resultant image data is 

so recorded on the memory card '8 through the memory 
card controller 21 4. 

[0065] In step ST7, a stop operation of the digital cam- 
era 1 such as actually turning off <the power is performed. 
[0066] , In step:ST8, whether or not the operation' is an 
55 initial image capture, i.e., a first image capture operation 
after power-on, Js determined. In the case of.the' Irt-itiai 
image capture, the process goes to step 'ST9.,Other.- 
y/ise, the process goes to step ST10.:-, ; , 
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[0067] In step ST9, raw data processed by the black 
level correction/white balance control part 211a is writ- 
ten into the DRAM 232 over the DMA channel 1 (cf. an 
operation Pa of Fig. 8). During the processing of step 
S9, a live view display is not produced, but if a full press 
of the shutter release button 9 is not detected in the sub- 
sequent step ST1 , the TG 314 is switched to the drive 
for live view display and live view processing (cf . an op- 
eration Pb of Fig. 8) is performed to resume a live view 
display. 

[0068] In step ST10, a frame of raw data obtained by 
an immediately preceding image capture and stored in 
the DRAM 232 is read out over the DMA channel 2 and 
is subjected to image processing such as color space 
conversion in the image signal processor 211 . This im- 
age processing, as indicated by the operation Pc of Fig. 
8, is performed by utilizing the time for exposure and 
storage in the CCD 303, i.e., the time during which a live 
view display is not produced. This allows the effective 
use of a non-live-view-display state. 
[0069] Step ST11 starts image compression by the 
JPEG section212 using the DMA channels 4 and 5,'and 
recording of image ; data on the memory card 8 through 
the memory card controller 214 using the DMA channel 
7 (cf. an operation Pd of Fig. 8). This processing cioes 
not use the image signal processor 2 11 and thus has no 
influence over a live view display. 
[0070] In step ST12, as in step ST9, raw data proc- 
essed by the black level correction/white balance con- 
trol part 21 1 a is written into the DRAM 232 oyer the DMA 
channel 1 (cf. an operation Pe of Fig. 8). Although both 
the operations Pd and Pe require access to the DRAM 
232 utilizing DMA, the arbitration by the bus controller 
218 allows alternate access by these operations; there- 
fore, outwardly, the operations Pd and Pe are performed 
concurrently. A higher bus band of the DRAM 232 per- 
mits smoother arbitration. ' r ' 
[0071] The operations described so far allow a live 
view display to be resumed immediately after raw data 
is written into the DRAM 232. This makes the time of not 
displaying a live view image in obtaining an image for 
recording shorter than before. Consequently,' framing, 
for the next image capture can 1 be provided to a user, 
which improves the convenience of a live view display: 

<Second Preferred Embodiment 

[0072] A digital camera 1 A according to a second pre- 
ferred embodiment of the present invention differs from 
the digital camera 1 of the first preferred embodiment in 
program data stored in the flash ROM 231 . Hereinafter, 
the operation of the digital camera .1 A wili be described. 



[0074] In step ST21, whether or not the shutter re- 
lease button 9 is fully pressed is determined. With a full 
press of the shutter release button 9, the process goes 
to step ST26. Otherwise, the process goes to step ST22. 

5 [0075] In steps ST22 and ST23, live view processing 
and display are performed as in steps ST2 and ST3 
shown in the flow chart of Fig. 7. 
[0076] In step ST24, whether or not the mode selec- 
tion switch 14 is used for a power-off operation is deter- 

10 mined. When the power-off operation is performed, the 
process goes to step ST25. 

[0077] !n step ST25, a stop operation of the digital 
camera 1 A such as actually turning off the power is per- 
formed. 

15 [0078] In step ST26, raw data processed by the black 
level correction/white balance control part 211a is writ- 
ten into the DRAM 232 over the DMA channel 1 . 
[0079] In step ST27, whether or not the shutter re- 
lease button 9 is pressed halfway down is determined. 

20 With a half press of the shutter release button 9, the 
process goes to step ST28. Otherwise, the process 
goes to step ST31 . 

[0080] In steps ST28 and ST29, the same processing 
as in steps ST22 and ST23 is performed. Here, it is as- 

25 sumed that a user intends to continue photographing; 
therefore, live view display is produced preferentially as 
indicated by an operation Qa of Fig. 10. This prevents 
a shutter release opportunity from being missed. 
[0081] In step ST30, whether the half -pressed posi- 

30 tjon of the shutter release button 9 is released or not, i. 
e., a user releases the shutter release button 9 or not, 
is determined. When the half-pressed position is re- 
leased, the process goes to step ST31 for image 
processing (cf. ah operation Qb of Fig. 10). Otherwise, 

35 the process returns to step ST28. 

[0082] In step ST31 , a frame of raw data obtained by 
an immediately preceding image capture and stored in 
the DRAM 232 is read out over the DMA channel 2 and 
subjected to image processing such as color space con- 

40 version in the image signal processor 211 . 

[0083] Step ST32 starts image compression by the 
JPEG section 212 and recording of image data on the 
memory card 8 through the memory card contro!ler2T4. 
[0084] In the operation described so far, a live view 

45 display is produced preferentially if the shutter release 
button 9 is in its half-pressed position when raw data is 
written into the DRAM 232. This allows a live view dis- 
play to be produced while a user is giving advance no- 
tice ©'photographing, thereby preventing, as appropri- 

50 ate, a shutter release opportunity from being missed. 
Consequently, the convenience of the digital camera 1 A 
is improved. 



<Operation of Digital Camera 1 A> 

[0073] . Fig. 9 is a flow chart olthe operation of the dig- 
ital camera 1 A. Fig. 1 0 shows an example of a sequence 
of operations of. the.digital camera 1A. * * . - » 



55 



<Third Preferred Embodiment 

[0085] A digital camera IB according to a third -pre- 
ferred embodiment of the present invention differs fronh 
the digital camera 1 of the first preferred embodiment in 
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program data stored in the flash ROM 231 . Hereinafter, 
the operation of the digital camera 1 B will be described. 

<Operation of Digital Camera 1 B> 

' 5 

[0086] Fig. 11 is a flow chart of the operation of the 
digital camera 1B. Fig. 12 shows an example of a se- 
quence of operations of the digital camera 1 B. 
[0087] In step ST41 , whether the shutter release but- 
ton 9 is fully pressed or not, i.e., an operation to acquire 10 
an image for recording is performed or not, is deter- 
mined. With a full press of the shutter release button^ 
the process goes to step ST46. Otherwise, ;the process 
goes to step ST42. , 
[0088] In steps ST42 and ST43, live, view processing 15 
and display are performed as in steps. ST22-. and ST23 
shown in the flow chart of Fig. .9. As .previously de- 
scribed, a live view display is produced at 30 frames per 
second. . : • . . 

[0089] In step ST44,- whether or not the-mode selec- 20 
tion switch 14 is used for a power-off operation is deter- 
mined. When the power-off operation is notperform&dy 
the process returns tc step ST41 ... : ;■. fOUX : 

[0090] In step ST45, a stop, operation of ..the- digital 
camera 1 B such as actually turning off the.power is per- 25 
formed. . ■;. c-l 

[0091] . In step ST46 f raw. data processed by the black 
level correction/white balance control part2t1a;ts writ- 
ten into the DRAM 232 over the Q MA channel 1 . ; 
[0092] In steps ST47 and ST48, jive yjew processing: 30 
and display are performed as in the above steps ST42 
and ST43. At this time, however, the intervals between 
live view displays are made longer by coratroHing the TG 
314 than in the case of normal live* view !dispiay,in the, 
above steps ST42 and ST43. As indicated:by operations 35 
Ra of Fig. 12, live view displays should preferabty?-be 
produced at about 10 frames per second .(frame dropr 
outs), which is about one third in the case of normal live- 
view display. 

[0093] In step ST49, the. steps of image processing 40 
are split into a plurality of partsand each split processing • 
is performed. More specifically, as- indicated by opera- 
tions Rb of Fig., 12, split processing^ cut iathe intervals 
of the above, live, view processing and therefore split 
processing and live view processing are performed al- 45 
ternately. Thereby,.time : cprresponding to 20 frames per 
second, the time being no longerf'ne.e.ded'in the above 
live view processing, can be spent jrvthe irnage process- 
in g n These, steps ST48 and_ST49 aHowja.Mve view dis- 
play to be produced from the instant immediately., after 50 
raw flata is written into the f DRAM 232;?in ; step,.ST46 (cf. 
an operation Rc of Fig. 12). t : ■ • 

[0094] In step ST50, whether sequential execution of 
the above split processing. completes alkimage. process- 
ing or not is determined. When all the image processing 55 
is .complete, the process goes^o step^STSI . Otherwise; 
the process returns to stepvSJ4-7;. Kl fir^:,. . ;..>. ; , 
[0095]->, In s^epSTSf t irjnageicompressipn by the JPE<3 
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section 21 2 and recording of image data on the memory 
card 8 through the memory card controller 214 are per- 
formed. 

[0096] . The operations described so far allow a live 
view display to be resumed immediately after raw data 
is written into the.DRAM 232. This makes the time of not 
displaying a live view image in obtaining an image for 
recording shorter than before. Consequently, the con- 
venience of a live view display is improved. 

<Fourth Preferred Embodiment 

[0097] > A digital' camera 1 C according to a fourth pre- 
ferred embodiment of the present invention differs from 
the digital camera 1 of the first preferred embodiment 
both in program data stored in trie flash ROM 232 and 
in a higher-capacity DRAM 232. Hereinafter, the opera- 
tion, of : the. digital :cam era r 1 C will be described. 

<Operation of Digital Camera 1C> 

[0098] : Fig; 43 'is. a: flow chart of ^the. operation of the 
digital camera TG^'Fig; 14 shows, an -example of a se- 
quence of operations/ofthe digital ■camera 1C. 
[0099] ; ; Iwstep ST61 , whether them's nutter release but- 
ton 9 is fully pressed o^notyi :e. j ^an operation to acquire 
an image for recording ts>: performed or not, is deter- 
mined: Witrua full press of 'the. shutter release button 9., 
the process goe si to step iST62- Otherwise, the process 
gctes:to step:ST63;..: : •-• - 

[0100] In step ST62, as indicated by operations Sa of 
Fig^-14, raw data processed by the black level correc- 
tion/white balance control part 21 1a is written into the 
DRAM 232 over the DMA channel 1 . Here, captured im- 
agedata obtained f on acquisition. of an image for record- 
ing is sequentially. accumulated in the DRAM 232 as raw 
data; therefore, the DRAM 232 of this preferred embod- 
iment requires a larger storage-:capacity than in the first 
preferred embodiment. j . 
[0101]- In steps ^ST63 to ST65, live view processing 
and .displays arid a power-off' operation are performed 
as in steps ST2 to ST4 shown in the flow chart of Fig. 7, 
[0102} dn: step ST66; whether there is raw data stored 
in the DRAM 232 or not, i.e., an operation to acquire an 
image for recording is performed or not, is determined. 
With raw data, the process goes to step ST67. 
[0103] In step ST67, all raw data stored in the DRAM 
232 are subjected to image processing and JPEG com- 
pression, then written into the memory card 8 (cf. an op- 
eration Sb of Fig. 14). 

[0104] In step ST68, a stop operation of the digital 
camera 1 Csuch as actually turnin g off the power is per- 
formed. 

[0105] The operations described so far allow a live 
view display to be resumed immediately after raw data 
is written, into the DRAM 232. This makes the time ol -not; 
displaying; a Jive view image in obtaining an image for- 
recording shorter than before: Consequently/ the con- 



EP 1 133 167 A1 



BNSDOCID: <EP 1 133167A1_I_> 



# 



13 



EP 1 133 167 A1 



14 



venience of a live view display is improved. 
[0106] White the invention has been shown and de- 
scribed in detail, the foregoing description is in all as- 
pects illustrative and not restrictive. It is therefore un- 
derstood that numerous modifications and variations 
can be devised without departing from the scope of the 
invention. 



of generation of said second image signal by 
said image capturing means and a timing of 
generation of said first image signal by said 
subsampling means. 

The digital camera according to either of claims 1 
to 5, wherein 



Claims 

1 . A digital camera <1 > comprising: 

image capturing means <303> capable of se- 
lectively generating a first image signal and a 
second image signal; 

storage means <232> for storing said second 
image signal; 

image processing means <21 1 > for performing 
first image processing on said first image signal 
and performing second image processing, 
which is lower in priority than said first image 
processing, on said second image signal; and 
timing control means <218> for storing said 
second image signal generated by said image 
capturing means into said storage means at a 
first timed instant, for supplying said first image 
signal generated by said image capturing 
means to said image processing means at a 
second timed instant after said first timed in- 
stant, and for reading out and supplying said 
second image signal stored in said storage 
means to said image processing means at a 
third timed instant after said second timed in- 
stant. 

2. The digital camera according to claim 1 , wherein 

said first image signal is an image signal for 
live view display, and said second image signal is 
an image signal for recording. 

3. The digital camera according to claim 2, wherein 

said second image signal is recorded on stor- 
age means <8> removable from said digital camera. 

4. The digital camera according to either of claims 1 
to 3, comprising: 

as a viewfinder <20>, only a display for dis- 
playing an image signal electrically. 

5. The digital camera according to either of claims 1 
to 4, wherein 

said image capturing means includes: 

subsampling means for generating a first image 
signal with subsampled pixels as compared 
with said second image signal; and 
switching means forswitching between a timing 



said image processing means includes first im- 
to age processing means for performing common 

image processing on said first image signal and 
said second image signal, and second image 
processing means for performing predeter- 
mined image processing on only said second 
'5 image signal, and 

said timing control means supplies said second 
image signal, which has gone through said 
common image processing , to said second im- 
age processing means and causes said second 
20 image processing means to perform said pre- 

determined image processing at a fourth timed 
instant after the completion of processing on 
' * said second image signal by said first image 
■ ;. processing means. 

7. The digital camera according to claim 6, wherein 
said common image processing by said first 

image processing means is filtering processing, 
■ and said predetermined image processing by said 
v second 1 image processing means includes com- 
pression processing for recording. 

8. The digital camera according to claim 7. wherein 
said filtering processing includes at least edge 

enhancement of an image signal. 

9. . The digital camera according to claim 6, wherein 
said timing control means stores said second 
image signal being processed by said second im- 
age processing means into said storage means at 
a fifth timed instant after said fourth timed instant, 
and reads out and supplies said second image sig- 
nal being processed and' stored in said storage 
means, to said second image processing means at 
a sixth timed instant after said fifth timed instant. 

10. The digital camera according to claim 9, wherein 
said second image signal being processed is 

an image signal for which said compression 
processing is completed. ■ 

11. The digital camera according to claim 9, wherein 
during generation of an advance second im- 
age signal and a subsequent second image signal 
respectively by an advs.nca image capture and a 
subsequent image -capture, said -timing control 
means arbitrates between said first and third timed 

• instants of access to said storage means and said 
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fifth and sixth timed instants of access to said stor- 
age means. 

12. The digital camera according to claim 1 t further 
comprising: 

indicating means for indicating the start of im- 
age recording; 

. judging means for judging the state of said in- 
dicating means; and 

. priority setting means for assigning priorities to 
said first image processing and said second im- 
age processing in said image processing 
means on the basis of the result of judgment by 
said judging means. 

13. The digital camera according to claim 12, wherein 

said indicating means is a two-position switch; 
and 

said priority setting means gives high priority to 
said first image processing when said judging 
means judges that said indicating means is 
pressed into its first position, and gives high pri- 
ority to said second image processing when 
said judging means judges that said indicating 
means is not in said first position. 

14. The digital camera according to claim 1 wherein 

processing at said first to third timed instants 
is performed as said second image signal is gener- 
ated. 

15. The digital camera according to claim T, wherein 

said timing control means interrupts process- 
ing on said second image signal by said image 
processing means and supplies said first image sig- 
nal to said image processing means at a fourth 
timed instant after said third timed instant. 

16. The digital camera according to claim 15, wherein 

said image processing means performs 
processing on said first image signal and process- 
ing on said second image signal alternately until 
processing on said second image signal is complet- 
ed. 

17. The .digital camera according to claim 16, wherein 

said timing control -means supplies said first 
image signal to said image processing means about 
ten times per second. 

18. The digital camera according to claim 1 , wherein 

said storage means is nonvolatile memory ca- 
pable of storing a plurality ofsecond image sig- 
* : nals; and ' , ; 
- v.: said timing control means supplies a plurality 



of second image signals stored in said nonvol- 
atile memory to said image processing means 
at said third timed instant. 

5 19. The digital camera according to claim 18, wherein 
said third timed instant is a timed instant of 
power-off. 
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